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Abstract 

We prove that under certain mild assumptions, the entropy rate of a hidden Markov 
chain, observed when passing a finite-state stationary Markov chain through a discrete- 
time continuous-output channel, is jointly analytic as a function of the input Markov 
chain parameters and the channel parameters. In particular, as consequences of the 
main theorems, we obtain analyticity for the entropy rate associated with representative 
channels: Cauchy and Gaussian. 

1 Main Results and Related Work 

Entropy rate for hidden Markov chains is notoriously difficult to compute, even in the case 
where both input and output alphabets are finite and time is discrete. However, recently 
much progress has been made in this setting; see, for instance [U [8j HI [12] and the references 
therein. 

In this paper, we consider a discrete-time channel with a finite input alphabet y = 
{1, 2, • • • , /} cl and the continuous output alphabet Z = R. Here, we remark that all our 
results in this paper can be straightforwardly translated to the setting where Z is finite or 
countably infinite. 

We assume that the input process is a 3^-valued first-order stationary Markov chain Y 
with transition probability matrix n = (tv^ixi and stationary vector 7r = (7T»)ixz (here we 
assume Y is first-order only for simplicity; a standard "blocking" approach can be used to 
reduce higher order cases to the first-order case). 

We assume that the channel is memoryless in the sense that at each time, the distribution 
of the output z € Z, given the input y e y, is independent of the past and future inputs 
and outputs, and is distributed according to a probability density function q(z\y). 

The corresponding output process of this channel is a hidden Markov chain, which will 
be denoted by Z throughout the paper. The entropy rate H(Z) is denned as 

H(Z) = lim -±-H(Z°_ n ), 

n-5-oo n + 1 



when the limit exists, where 



H(Z\) = - [ p(z°_ n )logp(z _ n )dz°_ n , 

J Z n + X 



here z Q _ n = (z^ n , Z- n +i, ■ ■ • , Zq) denotes an instance of Z°_ n = (Z_ n , Z_ n+1 , ■ • • ,Z ), and 
p(z°_ n ) denotes the probability density of z Q _ n . It is well-known (e.g., see page 60 of [7]) that 
if H{Z°_ n ) is finite for all n, then the limit above exists and can be written as 

H(Z) = lim H n (Z), 

n— >oo 

where 



H n (Z) = - [ p(z°_ n ) logp(z |C^° n ; 



(1) 



here p(^o|^-n) denotes the conditional density of zq given z_ n . Since the channels considered 
in this paper are memoryless and Y is stationary, we have 

H(Z°_ n \Y° n ) = (n + l)H(Z \Y ), 

where 



It then follows from 



H(Z \Y ) = -^Tty J q(z\y) logq(z\y)dz 



H{Z Q _ n \Y\) < H{Z\) < H(Y° n ) + H(Z\\Y° n ) 

that if J z£Z q(z\y) \ogq(z\y)dz is finite for all y G y, then the formulas for H(Z) above hold 
and H(Z) is finite. 

Unless specified otherwise, we will assume that II = II s = (jrL) is analytically parameter- 
ized by £* G Qi, where fij denotes a bounded domain in IR mi (here, a domain is an open and 
connected set), and for any (y, z) G y x Z, q 9 (z\y) is analytically parameterized by 9 G ^2, 
where denotes a bounded domain in R m2 . 

In earlier work, we established analyticity of entropy rate as a function of the underlying 
Markov chain parameters: 

Theorem 1.1. [5, Theorem 1.1] Assume that for any y^y, q{z\y) is positive and contin- 
uous on Z, and the following two integrals 

/ q(z\y)\\ogmmq(z\y')\dz, / q(z\y)\\ogm&xq(z\y')\dz (2) 
Jz v Jz y 

are finite. IfU is strictly positive at Eq, then H(Z) is analytic around Eq. 

(we remark that the hypotheses ([2]) were inadvertently omitted in [51 Theorem 1.1].) 

The aim of the current paper is to prove analyticity as a function of both the Markov 
chain parameters and channel parameters. Simple examples show that H(Z) can fail to be 
analytic as a function of the channel parameter alone; see Example 14.41 Our positive results 
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require several technical regularity conditions, which we describe as follows. These conditions 
involve the complexification of the channel density functions (by definition, any real analytic 
function, such as q (z\y) as above, at a given point can be uniquely extended to a complex 
analytic function on some complex neighborhood of the given point; we will continue to use 
the same notation, such as q (z\y), for this complex extension). We require these technical 
conditions, which abstract the properties of commonly used probability density functions 
(e.g., Cauchy and Gaussian), in order to make our proofs work. There may be more general 
conditions that suffice. On a first reading, the reader may want to skip directly to the 
statements of results below. 

Our regularity conditions are as follows. For given (eio,9o) G fli x Q 2 , 

(a) n is strictly positive at 6$; 

(b) for all y G y, q e °(z\y) is positive on Z; 

(c) there exists r 2 > such that (below, C? 2 (r 2 ) denotes the r 2 -neighborhood of 9 in 

C m2 ) 

• for any (y,z) ey x Z, q e {z\y) is analytic on C^ 2 (r 2 ), 

• for any y G y, q e (z\y) is jointly continuous on Z x C^ 2 (r 2 ), 

• the following three integrals 



(i) j q(z,r 2 )dz, (ii) j q(z,r 2 )\ogq(z,r 2 )dz, (Hi) j q(z,r 2 ) log q(z,r 2 )dz, (3) 

are all finite, where 

q(z,r 2 ) = sup \q $ (z\y)\, q(z,r 2 ) = _ mf \q\z\y)\- 
(y,e)eyxc™Hr 2 ) (y,e)ey xc^(r 2 ) 

(d) for some I G {1, 2, . . . ,/}, 

(i) there exist r 2 > such that for all j, the family of functions {g z {9) = q e (z\j)/q e (z\I)} z 

— * 

on 9 G C^ 2 (r 2 ) is equicontinuous, 

(ii) there exists r 2 > such that for each z, the real logg e (,2|/) can be analytically 
extended to C^" 2 (r 2 ) and for all j, 



/ sup q\z\j) log q e (z\I) dz < 00. (4) 



It is easily seen that the most commonly used channel models, including Cauchy and Gaus- 
sian channels, satisfy all of these conditions (these channels are defined below). 

Our first result deals with the case where the q 6 (z\i) are in some sense "comparable" with 
one another. 
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Theorem 1.2. For given (eo,@o) G fii x Q 2 , assume Conditions (a), (b), (c) and (d). If, 
there exist C, C" > such that for all i,j and all z G Z, 



C < 



[zi] 



<C", 



(5) 



then H(Z) is analytic around (eq,9q). 

Theorem 11.21 applies to the additive Cauchy channel, parameterized by (7*, 7, > 0, with 



q[z\t) 



7T (Z - Hi) 2 + H 



(6) 



So, for this channel, if II is strictly positive at Eq G Qi, then H(Z) is analytic around 

(eb, (71,^1,72,^2, A*i))- 

Our next result deals with the case where for one particular i, the density g dom- 
inates all the others. The reader should note that while Theorem 11.21 above requires a 
condition to hold at one given parameter value, 8q, Theorem 11.31 below requires a condition 
to hold for all parameter values 9 in a complex neighborhood of the given #o- 

Theorem 1.3. For given (£*o,$o) G Vt\ x Q 2 , assume Conditions (a), (b), (c) and (d). If, 
in addition, for the same I as in Condition (d), there exists r 2 > such that for any e > 0, 
there exists a compact subset E C Z such that for all z £ E, all j ^ I and all 9 G C^ 2 (r2) 



q e (z\j) 



< e, 



(7) 



q°(z\I) 

then H(Z) is analytic around (eq,9q). 

Theorem 11.31 applies to the additive Gaussian channel parameterized by (crj,//j), o~i > 0, with 

q ( z \i) = _^ e -(*- W ) 2 /(2<a (8) 



where some o~i is strictly larger than all other ones. Setting J = % to be the index cor- 
responding to the largest value of o~i, it is easy to see that indeed (jSJ) satisfies Condition 
(J7J). So, for this channel, if II is strictly positive at Eq G Qi, then H(Z) is analytic around 

(e , (ci,^i,0"2,^2, • • • ,cr h Hi)). 

Our final result deals with a case of more theoretical interest, namely: for all i, the real 
part of q e (z\i) "dominates" the imaginary part of the complex extension. 

Theorem 1.4. For given (eq, 9q) G Qi x Q 2 , assume Conditions (a), (b) and (c). If, in 
addition, for any 5 > 0, there exists r 2 > such that for all (y, z) G (y, Z) and all 9 6 

(i) |9(/W»))|<*|»(/(2|»))|, (ii) log 
then H(Z) is analytic around (eq,9o). 



q e {z\y) 



q 8 °(z\y) 



<5, 



(9) 
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Theorem 11.41 applies to additive Cauchy channels parameterized in fl6]) and other more 
artificial channels. 

These results can be regarded as extensions of [31 Theorem 1.1], which deals with the 
case where Z is finite. The flow of the proofs of these results follows that of this case. 
However, new techniques are needed to deal with the continuous case. This is most notable 
in Theorem II A\ where the use of a complex Hilbert metric [6], to replace the classical real 
Hilbert metric, is critical. This metric was also used in the proof of Theorem 11.11 It is not 
needed for Theorems 11.21 and 11.31 because those results assume stronger conditions on the 
channel density functions. 

We remark that in [31 Theorem 1.1], zero values are allowed for some transition probabil- 
ities. It seems more difficult to handle this phenomena in the continuous-state setting; this 
is the subject of forthcoming work. 

To the best of our knowledge, the results in this paper, together with those in [5], are 
among the first results establishing analyticity of continuous-state hidden Markov chains. 
Given the interest in the counterpart results for the discrete-state setting, we expect that 
such results will be of significance in the continuous-state setting as well. 

The remainder of this paper is organized as follows. In Section [21 we review the (real) 
Hilbert metric, outline the framework of the proofs of our theorems and highlight the dif- 
ferences among the proofs. The following two sections are devoted to proving Theorems 11.21 
and 11.31 In Section [51 we review the complex Hilbert metric. In Section El we prove Theo- 
rem [L4l 



2 The Main Idea of the Proofs 

We first briefly review the classical (real) Hilbert metric. The real Hilbert metric will be 
used in the proofs of Theorems 11.21 and 11.31 

Let W be the standard simplex in the /-dimensional real Euclidean space, 

W = {w = (wi, w 2 , ■ ■ ■ , wi) e R l : w, > 0, w i = 

i 

and let W° denote its interior, consisting of the vectors with positive coordinates. For any 
two vectors v , w G W°, the Hilbert metric ITT] is defined as 



,'Wi/Wj , 

d H {w,v) = max log — j—^ . (10) 



Vi/V 



It is well known and easy to see that on W°, the Hilbert metric dominates the Euclidean 
metric up to a positive constant (i.e., for some K > and all x,y e W, \x — y\ < Kdn{x, y)); 
also, on any compact subset of W°, the two metrics are equivalent (see Proposition 2.1 of [3]). 

For an I x I positive matrix T = (t^) (i.e., each Uj > 0), the mapping fa induced by T 
on W is defined by 

M«) = (ID 

where 1 is the all l's column vector. The following theorem is well-known (see [TTj). 
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Theorem 2.1. For a positive T , fx is a contraction mapping on the entire W° under the 
Hilbert metric and the contraction coefficient (often referred to as the Birkhoff coefficient), 
is given by 

d H {vT, wT) 1 - V<j)(T) 

T(T) = SUp —, r— = . , (12) 

vfbw d H (v,w) 1 + V /0(T) 

where <J>(T) = mm iJA i 

We will also need a complex version of W, 

W = {w = {w h w 2 , ■ ■ ■ ,wi) G C l : = 1}. 

i 

And for any D C W and 5 > 0, we define 

Wd(8) = {w G W : \w — w\ < 5 for some w}. 

For each z G Z, define IT 5 ' (z) as an I x / matrix with the entries 

W>\z) l3 = 4/(z\j), for all (13) 

By (fTTl) . IF' 61 ^) will induce a mapping /f' 9 = f u e,e^ from IF to PF. For any fixed n and 
z°_ n , define 

xf = xf(zi n ) = f>\ yi = ■ \z h zi- u • • • , z. n ), (14) 

(here • represent the states of the Markov chain Y) then similar to Blackwell [1], {xf 6 } 
satisfies the random dynamical system 

4i = fiiM% (is) 

starting with 

^-n-i = (16) 
where n 6 is the stationary vector for IF. And obviously we have 

p^(z \z. n )=x^\z )l, (17) 

and 

P S '\Z\) = 7r £ n^Vn)n^Vn + l) " " " Tf' e \zo)l. (18) 

Evidently x e f , p e,e (z \z_ n ) and p e ' 6 {z°_ n ) all depend on the real vector (e,8) e^x Q 2 - 
In what follows, we shall show that they can be "complexified". For r 1; r 2 > 0, let C^ 1 ^!) 

denote a r^-ball around sq in C mi , and C^ 2 (r2) denote a r 2 -ball around 9$ i n C™ 2 . For any 

e g C^^ri), one checks that for r\ > small enough, the stationary vector tt 6 is unique and 
analytic on C^^rx) as a function of £ (because it is the unique solution of 



^irw; 53<=i). 
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Then through (ITS]) and (fT5I) . a^' can be analytically extended to C^ 1 ^) x C^ 2 (r 2 ); 

furthermore, through ffT7|) and f|T8|) . p e ' 9 (,2o|z_„) and p £,6, (^° n ) can be analytically extended 
to C^ 1 ^) x Cp 2 (r 2 ). Ultimately H £ r f{Z) (which is defined by ([TJ) with real superscripts 

(e, 6) on p(z°_ n ) and p(zo\zZ n )) can be analytically extended to C^(ri) x C^ 2 (r 2 ) as well. 

The proofs of the main results require the mappings f £ ' to be contraction mappings with 
respect to the Euclidean metric. This will be derived from contraction, with respect to the 
Hilbert metric, the equivalence of the Hilbert and the Euclidean metrics and re-blocking into 
non-overlapping blocks. Namely, we will consecutively re-block the Z process to a Z process 
such that Zi is of the form zty). For any i{ = z^), let flf denote the composed mapping 

fzf ° fzf_! ° • • • ° fzf- Then, Xj, can be similarly defined as before: For any fixed n and zZ^, 
define 

xf = xfizlfr) = p e ' e (y k (i) = ■ \zi, Zi-u ■ ■ • , z_ A ), (19) 
then, } satisfies the random dynamical system 

^i=fSLvfi (20) 

starting with 

*3Li = ^- (21) 
The framework for the proofs of the main theorems can be outlined as follows: 

(I) If necessary, we consecutively re-block the Z process to a Z process such that Zi is of 
the form Z k , 1 ). 

3W 

(II) We then show that there exists a complex neighborhood of a subset of W such that each 
complexified /J' is a contraction mapping, with respect to some metric, and moreover 
the complexified x^' 9 (zZ^) stays within the neighborhood. 

(III) It then follows that the complexified x\ )6 (z l _ n ) and thus the complexified p £,d (z \z^ n ) 
exponentially forget their initial conditions. 

(IV) This, together with bounding arguments, will further imply that the complexified 
H^' e (Z) uniformly converges to a complex analytic function, which is necessarily the 
complexified H £,e (Z), on a complex domain, and therefore H e ' e (Z) is analytic. 

Although the three proofs all fit in the same above-mentioned framework, there does not 
seem to be a natural way to unify them. Among numerous differences, the most essential 
one is the way we establish (II): 

• For Theorem II .2\ as i increases, the real x e f always stays within a compact subset D of 
W°. To establish (II), we will use the fact that each real fp is a contraction on W°, and 
thus on D, with respect to the Hilbert metric. Then we use the equivalence between 
the Euclidean metric and the Hilbert metric on D, and equicontinuity in Condition 
(d(i)) to establish the contractiveness (with respect to the Euclidean metric) of the 

complexified /J' on a complex neighborhood of D. 
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• For Theorem II .3[ as i increases, the real xf may move arbitrarily close to the boundary 
of W. To establish (II), we apply a dichotomy argument: there is a sufficiently large 
compact subset £ of Z such that for any z,{ = 2^,v with Zj^ G S, the complexified 

/|' is a contraction on a complex neighborhood (under the Euclidean metric) of W°; 
for any Zj = with ^ S, we directly establish (II) by estimating the first-order 

derivative of the complexified /|' . 

• For Theorem 11.41 as i increases, the real x { ' may move arbitrarily close to the bound- 
ary of W. To establish (II), the complex Hilbert metric in Section [5] is employed to 
directly show the contractiveness, with respect to the complex Hilbert metric, of the 
complexified fp on a complex neighborhood of W°. 



3 Proof of Theorem [EZ] 

The following lemma says that fp does not change much under a small complex perturbation 

Of (£,#). 

— # 

Lemma 3.1. For any 5 > 0, there exist r 1 ,r 2 > such that for any (e,9) G C^(ri) x 
( C^ i2 (r 2 ) ; any z G Z and any x G W , we have 

\f?(x)-f*"*>{x)\<6. 

Proof. Since 

^ _ xU^(z) x(W>%z)/q%z\I)) 



xIL*> e (z)l x(U^(z)/q%z\I))l 
the lemma follows from (jSJ) and Condition (d(i)). □ 

Recall that Wjj(S) = {w G W : \w — w\ < 5 for some w G .D}. 

Lemma 3.2. Given any (e , #o) G f2i x fi 2 ; /or any compact subset D ofW°, there exists 
ri, T2, 5 > 0, < pi < 1 and a positive integer no such that, for all z\ with j > i + uq and all 

(e,6) G C^(ri) x C"? 2 (r2) ; / e j zs a p\- contraction mapping on Wd(8) under the Euclidean 

metric. 

Proof. For any z & Z and sufficiently small r 1; r 2 > 0, one checks that for any u,v G D, we 
have 

d H (uW°' ffo (z), vW°'°°(z)) = d H {uW\vW°). (22) 
It then follows that for any zf, 

d H {f/°{u),f/ {v)) < r(U^ +1 d H (u,v), 
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where t(IF°), the Birkhoff coefficient of IF as defined in (fT2l) . is strictly less than 1. It then 
follows from the fact that the Euclidean metric and the Hilbert metric are equivalent on D 
(see Proposition 2.1 of [3]) that there exists C > such that for any z\ and any u,v G D, 

\f/\n) - ff°(v)\ < Cr(U^y- l+1 \u - v\. 

For n sufficiently large, p := CV(n eo ) n ° < 1. Thus, for j > i + n , 

\D w f £ Y \< Po <l 

for all w G D. From this and Condition (d(i)) it follows that there exists r 1 ,r 2 ,S > 0, 
< pi < 1 such that 

\D w ff\ < pi < 1 

for all w G W D (8) and (e, (9) G C^n) x C^ 2 (r 2 ). The lemma then follows. □ 

The following lemma essentially follows from the framework in the proof of Theorem 1.1 
in [3] . We briefly outline the proof for completeness. 
We first introduce some notation. Let 

f^z \zZ^^/^z \zZl)/q\z \I), 

where / is the same as in Condition (d). 

Lemma 3.3. 1. There is a compact subset D of W° such that for any S > 0, there exist 
r 1 ,r 2 > such that for any (e,6) G C^(ri) x Cj? 2 (r 2 ) and for all z°_ n G Z n+1 and 
-n-l<i<-\, 

sfVj e W D (8). (23) 

2. There exist r±, r 2 > such that for all z°_ n G Z n+1 , p e ' e (zo\zZn) is analytic on C? 1 ^) x 
C-(r 2 ). 

3. There exist n, r 2 > 0, < pi < 1 and L\ > such that for any two Z -valued sequences 
{a°_ ni } and {b°_ n J with a°_ n = b°_ n and for all (e,9) G Cj£ l (n) x C^ 2 (r 2 ) ; we have 

\f>%a \aZlJ - f^boKlJl < L x p\. (24) 

Proof. 1. For a fixed uq > 0, we will consecutively reblock zZ} n to ill such that each Z{ is of 
the form zjf), where k{i) — j(i) + 1 = n (n is determined below). 

By (fl5j) and Condition (jSJ), for any and i, x^ ' 00 (and thus x^ ' 90 ) belongs to a compact 
subset D of W°. By Lemma [3721 we can choose r 1; r 2 , 5 > sufficiently small, n sufficiently 
large and < pi < 1 such that for all (e, 9) G C^ x (ri) x C^ 2 (r 2 ), /|' is a pi-contraction on 
W£)(5) under the Euclidean metric. 

To prove (I23l) . it is enough to prove the version of (|23|) with scf' (zi n ) replaced by x^' 9 (zL n ) 
(with perhaps smaller ri,r 2 ). 
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To see this, note that by Lemma 13.1 [ for sufficiently small ri,r2 > 0, for all z, x G W, 

), 

\ff{x)-ft' i \x)\<8{l-p 1 ) 1 (25) 



and (e,6)eC£( ri )xCJ*(r 2 ) 



and for all e G C^(ri) 

k f -7r(£ )| <S(1- Pl ). (26) 

Thus, 

\^-^ A \ = \fl*tfi)-f%H*M°)\ 

< l/f>fi) - /f>£'f°)l + l/f>£f°) - /f /o (C'f°)i- (27) 
Then by and and (f27J), we have 



xf -x?' e °\< Pl \xff 1 -xfA°\ + Pi)- 



So, for all i, 



l^-^l <6, 



and thus for all i, we have a^' 6 * G Wd{S), as desired. 

2. It follows from ([5]) and Condition (d(i)) that for sufficiently small r±,r2,S > and 
any z G Z, ff\x) is analytic with respect to (e,0,x) G Cg^ri) x C^ 2 (r 2 ) x W D {5). It then 

follows from this fact and the iterative nature of x^' 9 (see (Tl5l) ) and Part 1 that for sufficiently 
small ri, r 2 > 0, each is analytic on C^(ri) x Cp 2 (r 2 ). Part 2 then immediately follows 



from (fTTl). 

3. Applying the same reblocking as in Part 1, we write 



*S=*?(^)=i^(w(o = -i6U a : 



Evidently we have 

x i+i,a Ja i+1 V x i,a)i x i+i,b J' b . +1 K 



Note that there exists a positive constant L[ such that for all (e,6) G C^(rx) x Cp 2 (r 2 ), 

I _ -£,9 I / r/ 

for all (e, 6 1 ) G C^ x (ri) x Cp 2 (r 2 ), where ri,r 2 > are chosen sufficiently small. Since /?' is 
a pi-contraction on Wd(S), we have, by Part 1, 
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This, together with (jSJ), implies that that there exists L\ > 0, independent of n\,n%, such 

xC-(r 2 ), 

If^aoKl) - f^boK'Jl < L lP «. (28) 



that for all (e, 9) G C^n) x C^ 2 (r 2 ), 



□ 

The following lemma should be well-known. We sketch the proof for completeness. 

Lemma 3.4. Let n\ and n 2 be positive integers and D a compact domain in C ni . Let f(9, z) 
be a jointly continuous function on D x M. 712 . Assume that 



J 



sup \f(6,z)\dz < oo. (29) 
2 eeD 



Then 

1. L„ 2 f(9,z)dz is continuous on D. 

2. If, for each z G Z, f is analytic on D, then J R „ 2 f(9,z)dz is analytic on D. 

Proof. Let E be a compact domain in W 12 . Let 5i, i — 1, 2, . . . be a sequence of positive 
numbers converging to 0. Consider a sequence of partitions of E: 

where diam(A ni ) < 5 n for all 1 < i < m n . Evidently, the corresponding Riemann sum 



Rn = ^f{e,Z i )vol{k n ^ 
i=l 

(here Zi G A n j) is continuous in 9. Then 

/ f{9, z)dz -R n = J2 (f(9, *) - 

By the compactness of .D and E, we deduce that for any Eq > 0, there exists N such that 
for all n > Nq, all 9 G -D and all z G A nj j, i = 1,2, . . ., 

\f(9,z)-f(9, Zi )\<s 

which implies that for any e > 0, there exists N\ such that for all n > Ni and all 9 £ D, 

J f(9,z)dz-R ri 

In other words, R n uniformly (in 9 G D) converges to 



< e. 



f(9,z)dz, 

and so J s /(#, z)cfe is continuous in (9 G .D. 

Now, take any increasing sequence of compact sets Ej whose union is M n2 . By ( 1291) . 
J s f{9,z)dz converges uniformly, in 9 G D, to L„ 2 f{9,z)dz, which is therefore continuous 
on D. This gives Part 1. 

Part 2 follows in the same way with analyticity replacing continuity. □ 
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We are now ready for the proof of Theorem 11.21 



Proof of Theorem ! We first show that there exist r 1; r 2 > such that for any n, H^ e (Z) 
is analytic on C^n) x C^ 2 (r 2 ). 
For a fixed n, recall that 



p^(z°_ n )\ogp^(zo\zZ^dz 



i 



Z n + 1 



where 



P e ' e {z°_ r , 



and 



/ / (^ol^) = ^f(z^)n^(z )i. 



Now, for any (<f, 0) G C£(n) x C^ 2 (r 2 ), we have 



(30) 



Since ^ P £ (y°- n ) is continuous and therefore bounded as a function of £ e C^fri), there 
is a constant K > such that 



sup 



|p £ -'Vn)l<^n SU P ^ 



(31) 



i= _ n {y,e)eyxc™ 2 (r 2 ) 



It follows from Part 1 of Lemma [3731 1 hat for sufficiently small ri, r 2 > 0, there exist Ci, C 2 > 
such that for any z n , 

C^l/^ol^)!^^, (32) 
which implies that for some C3 > 0, 



|logp £ ' y (z |z^)| <C 3 . 
It then follows that for any (e, 9) E C^(ri) x C^ 2 (r 2 ), 



(33) 



sup 

H o 



sup 

(?/)ec™Vi)xC^ (r2 ) 



jf'Vn) Iog/(Z |/) +/'^n) log/' e (z |^; 



dz°_. 



< 



+ 



sup .K" 

eec™ 2 (r 2 ) 



n 



logq e (z \I) 



sup 

Z"* 1 (^ec s ?Mr-i)xC^ (r2 ) 



|/ tf (^„)||l0g^(2b|Ol^<00- 



hi 1 



(34) 
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(for the first term we have used ([3]^)) and (j4j); for the second term, we have used ([3]^i)), (I3T1) 
and ([33D). By lemma GOO (Part 2), 



H £ /(Z \ZZI 



is analytic on C^(n) x C? 2 (r 2 ). 



/' e (^ n )log/^(^ |^)^ 



-i w~o 



Now, to prove the theorem, we only need to prove that there exist ri,r2 > such that 
H^' 6 (Z) uniformly converges on C^iri) x Cp 2 (r 2 ) as n — > oo. First, we observe that 



1 (Z)-Hf(Z)\ 



1 






1 Z n ~ 


h2 




! 






I z n ~ 


^2 




f 


/> 


e \z°_ 


1 z n - 


h2 





p^(z\) log f '^zolzz'jdz^ 



Z n + 1 



p^(z°_ n ) log f^zolzl'jdz^ 



Z n+1 



Fix (e,9) G C^(ri) x C^ 2 (r 2 ). Then, by ([24]), ([32]), ([33]), we have, for some < p x < 1, 
l/' e ^Vi)(log/'^o|^-i) -log/' e ^o|^))| < L[ |p e ' V„-i)(^>o|^-i) -f'\z Q \zZ l n )) 
Notice that for any given 5 > 0, there exist ri, r 2 > such that for all e G C^^ri), 

and for any y G y and all # G Cp 2 (r 2 ), 

\q\z\y)\dz<(l + 5) [ q°°(z\y)dz=l + 5, 
z Jz 

(here we have used the fact that J z \q e (z\y)\dz is a continuous function of 9 G C^ 2 (r 2 ); this 
follows from Lemma [3.41 (Part 1)). It then follows from f[3Tl) that 



|/-fe-l)I^In-l<(l + 5) 2( 



n+2) 



Z n + 1 



By choosing 5 > sufficiently small, we can combine all the relevant inequalities above 
to obtain some L > and some < p < 1 such that for all (e, 6) G C^(ri) x C^ 2 (r 2 ), 

\H%{Z) - Hf(Z)\ < [ Ip^zl^ilogf^ZolzZU) - logf^{z \zZl))\dzZ n ^ < Lp\ 

which implies the uniform convergence of H^ e (Z) on C^ 1 (ri) x C^ 2 (r 2 ) as n tends to infinity, 
and thus the analyticity of H £,d (Z) around (e ,9 ). 

□ 



13 



4 Proof of Theorem 



1.3 



The following lemma is an analog of Lemma 13.11 

— # 

Lemma 4.1. For any 5 > 0, there exist r 1 ,r 2 > such that for any (e,9) £ C^ x (ri) x 
Cp 2 (r 2 ), any z £ -Z and any x £ VT, we have 



\ff(x)-fl°> e \x)\<6. 



Proof. Note that for any x £ W, 



f,e { , = xU^jz) = x(W>%z)/q%z\I)) 
xU^{z)l x(U^(z)/q%z\I))l 

It then follows from (j7|) that for sufficiently small r 1; r 2 > 0, there exists a compact subset X C 
Z such that for any (e, 9) £ Cg{r x ) xC^ 2 (r 2 ), any z g E and any x £ W, x(U^(z)/q ff (z\I))l 
is bounded away from 0. On the other hand, by the compactness of £, we deduce that 
there exist ri,r 2 > such that for any (s,6) £ C^(ri) x C^ 2 (r 2 ), any z £ Z and any 

x £ W 7 , a^IF' (z)/g (z|/))l is bounded away from 0. The lemma then follows from Condition 
(d(i)). □ 

Lemma 4.2. 1. Given any (£*o> #o) £ Qi x Q2, there exist ri,r 2 ,o~ > 0, < p\ < 1 and a 
compact subset Y, C Z such that for any z £ ana 1 a// (e*, 6*) £ C^^ri) x C^ 2 (r 2 ) ; /|' 

a p\- contraction mapping on WV(<5) under the Euclidean metric. 

2. Given any (£o;$o) £ ^i x £7 2; /or any compact subset T, C Z, there exist ri,r 2 ,o~ > ; 
< pi < 1 and a positive integer no such that, for all z\ with z% £ £ and j > 2 + no 

and a// (e, 9) £ C^ x (ri) x C^ 2 (r 2 ) ; f £ J B is a p\- contraction mapping on Ww{$) under 

the Euclidean metric. 

Proof. 1. For any x £ W, 



ff>*>(x) 



X 



W° (z) x (IP < §0 (z) //° (z\I)) 



x Y[e A ( z )i x (JJe ,0 (2) / q O (z | /) ) 1 



Observe, by the quotient rule, that D x f z 0,e °(x) is a rational function of entries of x with 
coefficients that are products of quantities of the form 7^ and q e (z\j) / q e (z\I) . By (J7|) (with 9 
set to be 9 ), we obtain the result at e = e and 9 = 9 . For general (e, 9) £ C^ 1 (n) x C^ 2 (r 2 ), 
the result holds by Condition (d(i)). 

2. For any two points x, y £ TP, we have, at (so, @o), 

d E (f zi (x)J zi (y)) d E {f 4 {x),f 4 {y)) f^l d H (f 4+1 (x)J 4+1 (y)) \ d H (f Zi (x), f Zi (y)) dEjfM, fM) 
d E (x,y) d H {f z j{x),f^(y)) l|l d H (f z k(x), f z k(y)) I d E {f Zi {x), f Zi (y)) d E (x,y) 
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where d E denotes the Euclidean metric. First, since the Hilbert metric dominates the Eu- 
clidean metric up to a multiplicative factor, there exists C\ > independent of all z\ such 
that for all k — i + 1, . . . , j, 

d E (f z j(x)J z j(y)) 

By the fact that f z is a contraction mapping on W° under the Hilbert metric, there exists 
< p < 1 independent of all z\ such that 

d H (f z k(x),f z k(y)) 

< Po- 



dH(f z k-i(x)J z k-i(y)) 

On the other hand, since the Hilbert and Euclidean metrics are equivalent on compact 
subsets of W°, and f Zi {W) is compact, there exists C 2 > 0, which only depends on S, such 
that 

d H (f Zl ( x )JzM) < c 
d E (f Zi (x),f Zi (y)) ~ 2 ' 

Finally, it can be easily checked that there exists C 3 > 0, which only depends on S, such 
that 

d E (fzA x )JM) < c 
d E (x,y) ~ 

Combining all the above inequalities, we deduce that there exists C4 > such that 

-7— ( s < <^4P > 

d E {x,y) 

which, together with Condition (d(i)), implies Part 2. □ 

— # 

Lemma 4.3. 1. For any 5 > 0, there exists ri,r 2 > such that for any (e, 9) e C^' 1 (ri) x 
C? 2 (r 2 ) and for all z°_ n E Z n+l and -n - 1 < i < -I, 

xf(zi n ) G W w {5). (36) 

2. There exist r±, r 2 > such that for all z°_ n G Z n+1 , p £ ' e (z \zZn) is analytic on C^^ri) x 
C ? (r 2 ). 

3. There exist r±, r 2 > ; < p\ < 1 and L\ > such that for any two Z-valued sequences 
{a°_ ni } and {b°_ r J with a\ = b°_ n and for all (e,9) E Cf^n) x C? 2 (r 2 ) ; we have 

if^aZl) - f'^bolb-Jjl < L lP \. (37) 



Proof. 1. For a given compact subset Ec2, consecutively reblock zj- n to a z_\ such that 
each ii = z^ % ) is of 

Type I: = k(i) and z j{i) g E; or 
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• Type II: zjm G £ and k(i) — > no, where no is as in Part 2 of Lemma [4. 21 

By Lemma l4~2l we can choose ri, r 2 , 5 > sufficiently small such that there exists < p\ < 1 
such that for all (e, 9) G C^(ri) x C^ 2 (r 2 ), /I' 6 * is a pi-contraction on W/V(<5) under the 
Euclidean metric. 

To prove (1361) . it is enough to prove the version of (1361) with x^' e (2;L ra ) replaced by xf(z % _^) 
(with perhaps smaller r 1; r 2 ). 

Now, choose r 1; r 2 > so small (the existence of r 1? r 2 is guaranteed by Lemma |4~T]) such 
that for any z, for all x G all (e, 0) G C^(r x ) x C^ 2 (r 2 ), 



and for all e G C^(ri) 



We then deduce that 



\f/(x)-fl°>°°( x )\<6(l- Pl ), (38) 
|7r r -7r r °| < 5(1 -pi). (39) 



\ x i+l x i+l I _ \J z i+1 \ x i J J z i+1 V X i )\ 

< \f!i(*f) -fZM A )\ + iC(^°) - fit^f A )\- ( 4 °) 

Then by (EHD and (El, and (SOI), for z > -ri - 1, we have 



So, for all i, 



\^-^\<P^ e -^°\ + ^-Pi)- 



\ x i+l x i+l I — °J 



and thus for all z, we have xf +1 G WV(<5), as desired. 

2. It follows from the same dichotomy argument in the proof of Lemma 14.11 that for 
sufficiently small ri,r 2 ,<5 > and any z <E Z, fl'(x) is analytic with respect to (e, 9,x) G 
C™(ri) x C? 2 (r 2 ) x It follows from this fact, the iterative nature of xf (see (fT5D) 

and Part 1 that for sufficiently small ri,r 2 > 0, each x\ ,d is analytic on C™(ri) x C^ 2 (r 2 ). 
Part 2 then immediately follows from (TlTl) . 

3. It follows from (I36I) and a similar argument as in the proof of Part 2 of Lemma [3731 □ 

We are now ready for the proof of Theorem 11.31 

Proof of Theorem \1.3[ By fl36|) . for sufficiently small r 1; r 2 > 0, there exist Ci,C 2 > such 
that for any z°_ n and any (e, 8) G Cg^i) x C? 2 (r 2 ), 

Ci<^(2b|«li)|<C7 2j (41) 
which implies that for some C3 > 0, 

\\ogf >\z \z-_l)\ <C 3 . (42) 
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Then, using the same argument as in the proof of Theorem II. 2\ we can show that there exist 
ri,r 2 > such that for any n, H^ e (Z) is analytic on C^ri) x C^ 2 (r 2 ). So, to prove the 

theorem, we only need to prove that there exist ri,r 2 > such that the H^ e (Z) uniformly 
converges on C^(ri) x C^ 2 (r 2 ) as n — > oo. This follows from ( )4T]) . ( 142]) and Lemma 14.31 
and a completely parallel argument as in the proof of Theorem 11.21 

□ 

With the following example, we show that for Gaussian channels, H(Z) need not be 
analytic even as a function of the channel parameters alone, when the largest <jj is not 
unique. 

Example 4.4. Consider an additive Gaussian channel parameterized as in OH]) with the 
binary input alphabet y = {1,2}. Assume that the input Y is an i.i.d. process with 



P(Y 1 = 1) = P(Yt = 2) = 1/2; 



and assume that 



q( z \l) = ^^ e - (z+1)2/<T S q(z\2) = — ^—e^-^l^. 



27RXi V27TO"2 



We then have 



p(z) = P(Y = l)q(z\l) + P(Y = 2)q(z\2) = I—^-^+W + I— ^-(-W. 

* V 27TCT1 * y/ llXOi 



We claim that for any fixed a > 0, analyticity of H(Z) as a function of (e>"i,cr 2 ) fails at 
(01,02) = (c - ) ")- To see this, we fix o\ = a, and we show that H(Z) is not analytic with 
respect to cr 2 at cr 2 = a. Note that for any real <r 2 , 

/oo 
p(z) \ogp(z)dz 
-oo 

= -f pW Hvk^'™) dz - />> H^k e ~^) dz (43) 



/■oo r0 

/ p(^)l0g(l + $,((7 2 ))^- / p(2)log(l + $; 1 ((T 2 ))^, 
JO J -oo 



(44) 



where 

$> 2 ) ^ %(-i) 2 /^ + iw and $J i ((72) a _L_ (45) 

0" "Pz^J 



We note that (143]) is analytic as a function of a 2 at cr 2 = a. To see this, observe that the 
first term of (T43]) can be further computed as 



POO POO -t POO -t 

log(2\/27a 2 ) / p(z)dz- / — t= (z-l) 2 e- {z+1)2/a2 dz- / J_ (s-l) V ( ^ 1)2/fT '^, 

Jo Jo 2\/2^acrl Jo 2^a\ 

which is analytic at er 2 = a since each of the three terms above is analytic at <r 2 = a (for the 
second or third term, regard cr 2 as a complex variable and use the exponentially-decaying 
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tail of the integrand). With a similar argument applied to the second term of (|43|) . we can 
then establish the analyticity of (H3|) . So, to prove H(Z) is not analytic at <T2 = a, it suffices 
to show that (I44T) is not analytic at o"2 = 

Suppose, by way of contradiction, that (jSJ) is analytic at <r, or equivalently, the following 
function of to 

1 £_ c -(, +1 ,^. + 1 « log (1 + ». (1/(i)))(b 

+ r f ^ e ^ +i)2 " 2 + ^^ (2_i)2w2 ) ^ ( x + (46) 

J-oo\ l V^ 2y/2n J 

is analytic at a -1 G C CT -i(r) (the closure of the r-neighborhood of cr -1 in C) for some r > 0, 
where, recalling from (|45p . 

$ z (l/ w ) = ^ e (-i) 2 - 2 -(-+i) 2 -- 2 . 

CO 



Then, by uniqueness, the analytic extension of f|46|) to C a -i(r) would agree with any analytic 
extension along the circle {a" 1 + re ta : a G [— 7r/2, 37r/2]} (from a; = — 7r/2 to a = 37r/2). 
Such an analytic extension is obtained by regarding wasa complex variable on the circle (this 
is a valid analytic extension by virtue of the exponentially-decaying tails of the integrands 
in (Ho]) ). Here, we remark that for any r > and a, there are at most two "singular" z (note 
that the following inequality boils down to a system of two quadratic equations in z) such 
that 

$ 2 (l/(a- 1 +re ja )) = -l, 

which means log (1 + $ z (l/(cx -1 + re ia ))) or log (1 + §~ l {l/(o~ l + re ia ))) would "blow up" 
at such z. However, an easy bounding argument (roughly speaking, the two "blowing up" 
terms will only do so "slowly") yields that during the analytic extension, (Ho]) is still well- 
defined with the presence of such singular z, and so the above analytic extension is indeed 
valid. 

Next, we will find a contradiction by showing that the analytic extension of fH6|) disagrees 
at a = — 7r/2 and a = 3tt/2. Setting to = a^ 1 + re ia , we then have 

° l _ _ cr 2 + er _1 r cos a — ia~ 1 r sin a ^ a (r,a)+ib{r,a) 

w a~ l + r cos a + ir sin a o~ 2 + 2a~ 1 r cos a + r 2 

where one can easily check that 

a(r, a) = 0(r), b(r, a) = O(r), q*' = 0(r). 
Then, some straightforward computations yield that 

$ Z (1/U) = e A (z,r,*) e iB(z,r,a)^ 

where 

A(z, r, a) = 2(z — l) 2 a~~ l r cos a + [z — l) 2 r 2 cos 2a — 4za~ 2 + a(r, a), 
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and 



B(z,r,a) = 2(z - \) 2 a~ x r sin a + (z - l) 2 r 2 sin2a + b(r,a). 



Now, for some small yet fixed e > 0, choose N > large enough and then r > small 
enough such that 

(1) for all < z < N and all a G [-tt/2, 3tt/2], B{z,r,a) G (-7r,7r); 

(11) for all z > TV and all a G [-tt/2 + e, tt/2 - e] U [tt/2 + e, 3tt/2 - e], 



4^(7 2 >|a(r,a)|, \2(z-l)a r cos a| > \(z - 1) r 2 cos 2a + a(r, a 



and 



d_ 

da 



(2(z- l)V _1 rsin 



a, 



(9a 



((z - 1)V sin 2a + 6(r,a)) 



Note that for all < z < N, by (I), $ z (l/u) will not go around —1 (in any direction) 
for one complete round as a increases from — n/2 to 3n/2. Next, we consider the case when 
z > N. Notice that, by (II), for any fixed z > N, as a increases from —tt/2 + e to tt/2 — e, 
B(z, r, a) increases as well. If, for some z > N and a G [—vr/2, — 7r/2 + e\ U [7r/2 — e, tt/2], 

A(z,r, a ) > 0, 

it then follows from (II) that there exists I = £(e) > such that £ — > oo as e — > and for 
the same z and any a G [—is, £e], 

A(z,r,a) > 0. 

On the other hand, it follows from (II) that for any z > N and for any a G [tt /2 + e, 3tt/2 — e], 

A(z,r,a) < 0; 

straightforward computations also yield that for any z > N and for any aG[7r/2,7r/2 + e]U 
[37r/2-£,37r/2], 

A(z,r,a) < 0. 

It then follows that $ z (1/oj) will not go around —1 (in any direction) for one complete round 
as a increases from tt/2 to 37r/2. 

We are now ready to conclude that as a increases from —tt/2 to 3tt/2, for any z > N 
with $ z (l/(o" _1 + re ia )) ^ —1, $ z (l/u) will go around —1 anti-clockwise k(z) times, where 
k(z) is a non-negative integer; meanwhile, one checks that when z is large enough, k(z) is 
strictly positive. The idea can be roughly described as follows. Consider the "trajectory" of 
& z (l/u) as a increases from — tt/2 to 37r/2. Obviously, A(z,r,a) > means the magnitude 
of the corresponding "location" is strictly bigger than 1; B(z,r,a) > means at the corre- 
sponding "location", $ z (l/w) is going anti-clockwise. The above argument shows that given 
sufficiently small e (and thus £ sufficiently large), for all the time when the "location" is at 
least 1 away from the origin, "more often" & z (l/ui) goes around —1 anti-clockwise (for any 
a G [—vr/2, — tt/2 + e\ U [tt/2 — e, tt/2], $> z (\/oj) may go around —1 clockwise, whereas for all 
a G [—£e,£e], <& z (l/oo) must go around —1 anti-clockwise). 



19 



So, for any analytic extension along the circle {a 1 + re ia : a G [— tt/2, 37r/2]} (from 
a = —tt/2 to a = 3tt/2), we have proven that for any z > with $ z (l/(cr~ 1 + re 4 ")) 7^ —1, 

9f( lim togfl + fc^l/^ + re**))) J = 9 ( lim log (l + $ All la' 1 + re iQ ))) ] +2fc(z)?n, 

ya->(37r/2)- y / \a->(-7r/2)+ / 

where fc(z) is a non-negative integer for all z and a strictly positive integer for all sufficiently 
large z. Using a similar argument, we can also prove that for any z < with $~ 1 (l/(cr~ 1 + 
re ia )) ^ -1, 

Q?( lim log(l + $7 1 (l/(a- 1 +re ia ))) ] = 3 I lim log (l + ST^l/Or -1 + re iQ ))) ) +2k(z)m, 

\a-»-(37r/2)- " '/ \a->(-7r/2)+ / 

where k(z) is a non-negative integer for all z and a strictly positive integer for all sufficiently 
large \z\. This, however, implies that for the above analytic extension, (j4U|) disagrees at 
a = —tt/2 and a = Sn/2, which is a contradiction. 



5 A Complex Hilbert Metric 

Recall that W denote the complex version of W, 

W = {w = (w u w 2 ,--- , wi) G C l : ^ w i = !}■ 

Let 

W>+ = { v e W : ^(Vi/Vj) > for all i,j}. 

For v,w E W + , define 

dn(v, w) = max 

where log is taken as the principal branch of the complex log(-) function (i.e., the branch 
whose branch cut is the negative real axis). Since the principal branch of log is additive 
on the right-half plane, dn is a metric on W + , which we call a complex Hilbert metric (for 
alternative complex Hilbert metrics, see [TD] and [2]). 

Let M denote the set of all / x I stochastic matrices, i.e., 

1 

M = {11= (iTij) G R lxl : TTy > 0, J2 *iJ = 1 >> 

i=i 

and let M denote the complex version of M, defined as 

l 

M = {11= (Try) G C lxl : J^TTy = 1, for all i}. 

3=1 

For a given positive IT G M and a small 8\ > 0, let Mri(^i) denote the (^-neighborhood, 
under the Euclidean metric, around LT within M. For an element IT G Mn(5i), similar to 



log 


( Wi 


/to A 




\ Vi 





(47) 
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dlH, II will induce a mapping /- on W. For a small 52 > 0, let Ww°,h(o~2) denote the 
^-neighborhood of W° within W + under the complex Hilbert metric, i.e., 



W W o H (5 2 ) = {v = {vi,v 2 , 
The main result of [6] states: 



,vi) G W + : d H (v,u) < 8 2 , for some u G W°}. 



Theorem 5.1. Let U be a positive matrix in M. For sufficiently small 5\, 5 2 > 0, there exists 
< pi < such that for any IT G Mn(^i), / n is a p\- contraction mapping on Ww°,h(^2) 
under the complex Hilbert metric in [J^D - 

For 5 > 0, let C R +[5] denote the "5-cone" of R + within C, i.e., 

Qr+ [S] = {x + yi <E C : x > 0, —5x < y < 5x}. 
The following Lemma can be easily checked. 

Lemma 5.2. For sufficiently small 5\ > 0, there exists a positive constant Li such that for 
any a, f3 E C M +[5i] 



log a — log /3\ < Li max 



\a — (3\ \a — (3\ 



ft 



The following lemma essentially follows from the proof of Part 2 of Lemma 2.3 in [6] (in 
particular, its Part 1 is just a rephrased version of Part 2 of that lemma), allows us to connect 
the complex Hilbert metric and the Euclidean metric. We give a proof for completeness. 

Lemma 5.3. 1. For any 5 > 0, there exists £ > such that for any x G W + , x G W° 
with dn(x,x) < £ ; we have Xi G Ww°,h{.&) for all i. 

2. For any ( > 0, there exists a constant C > such that for any x, y G W + with 
\x — x\,\y — y\ < ( for some x, y G W° , we have 

\x- y\ < Cd H (x,y). 

Proof. We only prove Part 2. Let £ = dn{x, y). Then we have for all i,j, 

Xi/Vi 



log 



xj/yj 



There exists C\ > such that for £ sufficiently small, and for all i, j, 



ft ; 



Xj/yj. Then for all i,j, 



Xj/yj 



< Ci£. Let 



\£i - ctj\)i\ < Ci£\aj\\yi 



and so 



11 — a-: 



i=i 



< \xi - UjU < Cxi\aj\ \m\ = Ci(l + B()t\ aj 



i=i 



i=i 



It follows that \xj -yj\< Cx{\ + BQ£\xj\ <C 1 (1 + B()£(xj + (), which implies Part 2, if £ 
is sufficiently small. □ 
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6 Proof of Theorem 



1.4 



The following lemma is an analog of Lemma 13.11 



Lemma 6.1. For any 5 > 0, there exist r\,r 2 > such that for any (e,8) G C^^riJ x 
< & r g 2 { r 2), any z G Z and any x G W , we have 



d H (ff(x),ry°(x))<s. 

Proof. Since all tt^^q) are strictly positive, for any 8\ > 0, there exists r\ > such that for 
all i,j and all e G C^(n), 

|7rJ -7Ty(£ )| 



Now, for any a; = (xi, x 2 , ■ • • , a;;) G W, any j and any e G C^ 1 ^), we have 
E!=i ZiOS - 7r<i(eb)) EL x i^ij{^o){^!j ~ ^ij(£o))/^ij(e 



Ei=i a; i 7r O-(so) 



Ei=i^ 7r ij(^o) 



<5i. 



Thus, for any 52 > 0, choosing 5i sufficiently small, we have 



log 



Ei=l X i 7l ij 



J2i=l X i 7r ijfa) 



log 1 + 



e!=i ^(^S -tufa)) 



E i= i »i7r<i(eb) 



< 5 2 



Notice that 

d H (/f^x),/fA(x)) 



max 



log- 



Ei=i 



max 



log 



log 



ELi^k^l^) 



Ei=i^ 7r ij(^o)^°( 2; |j) E^i^^^o)? ^^^) 



+ log 



g*(z|j) 



log 



ELi^ 



log 



g e (^|A;) 



E^i^i^i^o) q e °(z\j) J2i=iZiTik(£a) q e "(z\k) 

It then follows from the second inequality of (Q that for any 5 > 0, there exist ri,r 2 > 
such that for any (e, #) G C^ x (ri) x Cp 2 (r 2 ) and any x G VK, we have 



d H {f/{x)Jt^{x))<5. 



□ 



The following lemma, roughly speaking, says that when we perturb (sq, 6q) "a bit" to 
(e, 6), fl> is still a contraction mapping on a complex neighborhood of W°, and the contrac- 
tion coefficient is uniform over all the values of z and 9. More precisely, recalling Ww°,h(S) 
denote the (^-neighborhood of W° of W under the complex Hilbert metric, we have 

Lemma 6.2. For sufficiently small r\,r2,8 > 0, there exists < p\ < 1 such that for any 
(s,9) G C^^ri) x Cp 2 (r 2 ) and any z G Z, fp e is a pi- contraction mapping on Ww°,h(8) 
under the complex Hilbert metric in [4~7\ ). 
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Proof. By (171) , we can choose ri,T2,S > sufficiently small such that for any z G Z, any 

(e,6) G C™ 1 ^) x C^ 2 (r 2 ) and any u, i; G 

d H {uW'%z),vU^{z)) 
is well-defined. Moreover, it can be easily checked that 

d H (uU^(z) , vW'%z) ) = d H {vjf, vU g ) . (48) 
The lemma then immediately follows from Theorem 15.11 □ 
The following lemma is also needed. 

Lemma 6.3. 1. For any 5 > 0, there exist ri,r 2 > such that for any (e, 6) G C^ 1 ^) x 
C^ 2 (r 2 ) and for any z°_ n G Z n+1 and —n — 1 < i < —1, 

xf{zl n ) G W W «, H {8), (49) 

and 

p £ ^(z \zZ l n )eC R+ [5]. (50) 
2. There exist r 1; r 2 > such that for all z°_ n G Z n+1 , p e ' d (z \zzl l ) is analytic on CT' 1 (ri) x 



C™(r 2 ). 



3. For sufficiently small ri, r 2 > ; there exist < p\ < 1 and a positive constant Li such 
that for any two Z -valued sequences {a°_ ni } and {^ n J with afz n = b°_ n and for all 
(e,e) G C^in) x C™ 2 (r 2 ) ; we have 

\f>%a \aZl)-p g >%\bzl l2 )\ < L lPl sup \q°' (a \y')\. 

(2//')eyxC"? 2 (r 2 ) 

Proof. 1. By Lemma [621 we can choose ri,r 2 ,5 > sufficiently small such that there exists 
< p\ < 1 such that for all (e, 6) G C T ^ L (ri) x C^ 2 (r 2 ), ff e is a pi-contraction mapping on 

W / w°,h(^) under the complex Hilbert metric. 

Now, choose r\, r 2 > so small (the existence of ri, r 2 is guaranteed by Lemma ISTTT) such 
that for any z G Z, for all x <EW, all (e, 0) G Cg 1 ^) x C? 2 (r 2 ) 

d H (ff(x), ff>*>(x)) < 5(1 - pO, (51) 

and for all f G Cg^n), 

^(vr £ ',7r(£ ))<5(l-p 1 ). (52) 

We then deduce that 

d H {x%x^) = d H (f!i(xf)J^(xf'" )) 

< d H (fZ(xf)J?i(x?>° )) +d H {f% l (x?A),f**( 3 **>)). (53) 
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Then, by (l5Tj) . ( 152]) and ( 153]) . for 2 > — n — 1, we have 

^gU&f') < pd H (xf,x?>°°) + 5(1 - Pl ). 

So, for all i, 

and thus for all i, we have x^' +1 G Ww°,h(8), as desired. This, together with ( iT7|) and 
Lemma [5731 (Part 2), implies ( 150]) . 

2. It follows from ([9](i)) and Part 1 of Lemma [5.31 that for sufficiently small ri,r 2 ,5 > 
and any z G Z, fp 6 (x) is analytic with respect to (e, 9, x) G C^ 1 ^) x CJ 2 (r 2 ) x 

It follows from this fact, the iterative nature of x^' 6 (see ( Fl5|) ) and Part 1 that for sufficiently 
small ri,r 2 > 0, each x £ f is analytic on C^ x (ri) x C^ 2 (r 2 ). Part 2 then immediately follows 
from dTTJ). 

3. For all (e, #) G C^(ri) x C^ 2 (r 2 ), we write 

xf! = xf(lt n2 )=^{y l = -\lt_J. 

Apparently we have 

Note that there exists a positive constant L\ such that 

dH{x e f na1 x e f n ^ < L'±, 

for all (e, 9) G C^^ri) x Cp 2 (r 2 ), where r 1? r 2 > are chosen sufficiently small. Then from 
( 1491) . we have 

d H (x_ l a ,x\ b ) < L lPl . 

Therefore, by Lemma |5~3] there exists a positive constant L" independent of ni,n 2 such that 
for any (e, 9) G C? 1 (n) x C^ 2 (r 2 ), we have 

\x% a -x% h \<L'{pl. (54) 

Now, using (jPTj) and the fact that 

/'Vo) = X}</(oo|jO, 

2/ 

we conclude that there is a positive constant L±, independent of ni,n 2 such that 

\p^a \aZiJ - p^ibolbz'Jl < L lP - sup |/(ao|lOI- ( 55 ) 

We then have finished the proof. □ 
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We are now ready for the proof of Theorem 11.41 



Proof of Theorem \1.4\ We first prove that there exist ri, r 2 > such that for any n, H% ' (Z) 
is analytic on C? 1 ^) x C? 2 (r 2 ). 
For a fixed n, recall that 



p^\z a _ n )\ogp^{z \z-_ l n )dz° 



2»+i 



where 



and 



^(zo|^) = ^(^)n^(z )i. 



Now, for any (e, 0) G C^(ri) x C? 2 (r 2 ), we have 



|P^>°JI < E II ^ E II _ SU P l9*W)l- (56) 



y — n 



fe'/')eyxc™ 2 (r 2 ) 
So 



And, by (|49j) . for sufficiently small ri,r 2 > 0, there exist Ci,C 2 > such that 



Ci . inf |/W)i<i/^o|^)i<C^ sup \/(z \y% (57) 



(y',e>)eyxc™ 2 (r 2 ) 



(y',e')eyxc"? 2 (r 2 ) 



which, together with (150]) . implies that for some C3 > 0, 



logp^{z \zZl)\ <C 3 + niax{|log sup |/(2o|y%log ^ inf |/> |y')|}- 



(2y'/')eyxc? 2 (r 2 ) 



(y'/')eyxc™ 2 (r 2 ) 



This, together with ©, implies that on Cg£(n) x C^ 2 (r 2 ) 



/ 



sup 



(e^eC^OxC™ 2 ^) 



/>Vjlog/^ |^) 



dz_ n < 00 



(58) 



By Lemma E31 (Part 2), H% e {Z Q \Zzl) is analytic on C£{r x ) x C^ 2 (r 2 ). 

Now, to prove the theorem, we only need to prove that there exist ri,r 2 > such that 
the H^' e (Z), as n — )■ 00, uniformly converges on C^(ri) x C^ 2 (r 2 ). Note that 



^)-#f(^)| 



Z"+ 2 J z n+l 



p e "*' e (^„_ 1 )(logp^(^o|^_ 1 ) - logp^(z Q |^))^Vi 



1\\ J„0 
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Fix (e,6) G C^(ri) x C^ 2 (r 2 ). Then, by Lemmas 15.21 and I6.3[ either we have, for some 



< pi < 1, L' x > and some 8\ with (1 + 8\)p\ < 1 
l/'^A-Jaog/'^ol^-J-log/'^^oi^))! < L[ 



efi ( sP ?,9 (^o|^-n-l) -/' e (^ok-n) 



P^ok-n-l) 



<Al/'fe-i)l^iP? sup \q S \z Q \y% 



fe',fi')eyxc7(r 2 ) 



or we have, for some < p\ < 1, L' x > and some 5i with (1 + 5i)pi < 1, 



< AI/^^H^^^I^JIL^ sup |g» (z \y')\. 

(y'/')GyxC"? 2 (r 2 ) 

Notice that for any given 8 > 0, there exist n, r 2 > such that for all e G C?(ri), 



<„J<(i + 5K 



£0 

y- n i 



7T 



!/»y«+i 



and for any y G y and all G C"? 2 (r 2 ), 



/ |/(*|j/)|dz<(l + <5) / g*>(z|y)dz=l + <f, 
J z Jz 



(here we have used the fact that f z \q 9 (z\y)\dz is a continuous function of G Cp 2 (r 2 ); this 
follows from Lemma [3.41 (Part 1)). It then follows from (|56|) that 



2n 



b^zLi)l^-i<(i + ^) 2(n+1) - 



Moreover, similar to (IBTj) . we have for some C4, C5 > 0, 

C 4 ^ inf \q e \z-n-i\y^\<\/>\z-n-i\z - n )\<C 5 sup |g e Vn-i|l/)|- 



(y',e')eyxc™ 2 (r 2 ) 



(?y',e')eyxc"? 2 (r 2 ) 



By choosing 5 > sufficiently small, we can combine all the relevant inequalities above 
to obtain some L > and some < p < 1 such that for all (e, 0) G C^(ri) x Cj? 2 (r 2 ), 

IflSfi(^) - #f>)l < / l/'^A-JaogP^^ol^-r) - log/^ |^))|^° n _i < V\ 



which implies the analyticity of H £,6 (Z) around (eq,9q 



□ 
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